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A  STOCHASTIC  REPRESENTATION  FOR  THE  PRINCIPAL  EIGENVALUE 
OF  A  SECOND-ORDER  DIFFERENTIAL  EQUATION* 


Ioannis  Karatzas 

Abstract 

Using  ideas  from  stochastic  control  we  derive  a  stochastic 
representation  for  the  smallest  eigenvalue  of  a  second-order 
differential  equation.  As  a  side-result  we  solve  an  associated 
stationary  control  problem  in  a  very  general  setting. 
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1.  INTRODUCTION  AND  SUMMARY 

In  the  present  paper  we  obtain  a  stochastic  representation 
for  the  principal  eigenvalue  X*  of  the  eigenvalue  problem 


z"(x)  +  2  (X  -<|>  (x) )  z  (x)  =  0,  in  1R 


(1) 


with  z(-)  even  and  $(•)  a  positive,  even,  C1  and  convex 

function  on  the  reals,  growing  like  x  ,  m  >  1  to  infinity  as 

|  x  |  -*■  «>.  Under  these  assumptions  on  <t>  ( • )  there  exists  a  discrete 

spectrum  for  problem  (1)  (see  Titchmarsh  [15],  vol.  laid 

Coddington  and  Levinson  [2]),  with  eigenvalues  0  <  X  =  XQ  <  X^< 

'  *  '  <  ^n  <  ‘  ' '  ’  ^n  "*  °°  as  n  00  and  corresponding  eigenfunctions 
2 

zn(x)  €  L  (0,°°),  n  €  IN,  having  exactly  n  zeros  on  ( 0 ,°° ) .  We 
prove  that  X*  admits  the  representation 


X 


* 


lim  y  In  E 

T-*oo 


exp{ 


[  <j»(x+w  )ds) 

]  o  s 


(2) 


for  any  x  €  IR,  where  {wt;  t  >  0}  is  a  Brownian  Motion  process 
on  an  underlying  probability  space  (ft,  P)  and  E  denotes 
expectation  with  respect  to  P. 

The  method  proceeds  by  considering  a  stationary  stochastic 
control  problem  associated  in  some  natural  way  with  equation  (1), 
along  with  the  corresponding  family  of  finite-horizon  optimization 
problems.  It  is  proven  that  X*  is  the  optimal  asymptotic  performance 
rate  for  the  statimary  control  problem.  A  major  step  is  then  to 
show  that  V(x,t),  the  optimal  expected  performance  for  the  control 


problem  on  the  finite  time  interval  [0,i],  satisfies  the  limiting 
relationship 

Vfx  x 1  * 

lim  -  —  -  =  X  ,  any  x  £  1R 

T-*-oo 

(Theorem  1).  Equation  (2)  follows  from  a  Feynman-Kac-type  stochastic 
representation  for  V(x,t).  On  the  other  hand,  a  candidate  for  the 
optimal  law  in  the  stationary  problem  is  discerned  from  the  corre¬ 
sponding  Bellman  equation  and  its  optimality  against  any  admissible 
nonanticipative  law  is  established  by  means  of  the  aforementioned 
limiting  relationship. 

Donsker  and  Varadhan  [3]  and  Holland  [8,9]  obtained  different 
representations  for  the  smallest  eigenvalue  of  second-order  elliptinc 
differential  operators  in  bounded  domains  under  natural  or  Dirichlet 
boundary  conditions.  Holland  [9],  in  particular,  establHied  a 
generalized  Ray leigh-Ritz  formula  in  this  setting,  using  ideas  from 
stationary  stochastic  control.  His  method  did  not,  however,  invoke 
the  corresponding  finite-horizon  problems.  Stationary  control 
problems  were  studied  in  some  generality  by  Wonham  [16]  and  Kushner 
[11].  Both  restricted  attention  to  laws  producing  an  ergodic 
diffusion  process.  For  an  example  of  a  stationary  control  problem 
in  which  general  nonanticipative  laws  are  admitted,  see  Benes  and 
Karatzas  [1]. 

2.  THE  STATIONARY  CONTROL  PROBLEM 

Denote  by  £*(•)  the  corresponding  to  X*  eigenfunction  of 

f»  2 

(z*00)  ax  =  1.  The  change  of 
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variables  z*  =  exp(-v),  v(-)  an  even,  positive  function  on  1R, 
yields  the  equation 


**  =  \  VXXCX)  *  \  v£(x)  +  ?(x)»  in 


(3) 


12  12 

Note  that  -  y  v  =  min(u-v  +  ■=-  u  )  ,  the  minimum  being  achieved  by 
t  x  u  x  L 

u*  =  -v  .  It  becomes  transparent  that  (3)  is  the  Bellman  equation 
for  a  stationary  control  problem  -  see  Wonham  [16]  -  to  be  intro¬ 
duced  in  detail  below. 

Consider  the  space  C[0,T]  of  real-valued,  continuous  functions 
on  [0,T],  some  T  >  0,  and  let  E  t ;  0  _<  t  £  T  denote  the  -field 
of  subsets  of  C[0,T]  generated  by  {x;  x€  C[0,T],  s  <  t} . 

Consider  also  the  o-field  of  subsets  D  of  [0,T]  *  C[0,T] 

with  the  property  that,  for  any  0  <  t  T,  the  section  belongs 

to  £t,  and  that  each  x-section  Dx,  x  6  C[0,T]  is  Lebesgue- 
measurable . 


Definition  1:  An  admissible  nonanticipative  control  law  u  is  a 
measurable  function 
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have  a  unique  (in  the  sense  of  the  probability  law)  weak  solution 
{(xt,wt);  0  <_  t  <  T)  on  some  probability  space  (f2,  3^)  , 

for  any  x  €  1R,  with  (wt;  t  >  0}  an  ^-adapted  Brownian 
Motion  process  and 

Ex  jolut(x)  lPdt  <  °°  (5) 

sup  E)x.  <  °°  (6) 

0<t<T  z 

holding  for  any  p  >  0.  Let  ^  denote  the  class  of  all  admissible 
nonanticipative  control  laws. 

For  instance,  if  u  is  bounded  such  a  solution  can  be  con¬ 
structed  via  the  Girsanov  substitution  of  measures  (see  Liptser 
and  Shiryayev  [12]).  If  u  is  a  function  of  (t,xt)  and  satisfies 
a  local  Lipschitz  and  a  global  linear  growth  condition  in  the  space 
variable  then  a  solution  of  (4)  exists  in  the  strong  Ito  sense. 

The  optimal  stationary  control  problem  can  now  be  formulated 

as  follows:  choose  a  law  u*  G  <2r  for  which  the  limit 

« 

T 

J(u\x)  =  lim  A  E*  f  (<J>(x!)  +  i  (u*)2)dt 

X-voo  1  x  J  0  1  L  Z 

exists  and  does  not  exceed  the  average  expected  total  cost 

T 

J(u,x)  *  T  Ex  j  <*(x?)  +  I  (ut(xu))2)dt  (7) 

of  starting  at  place  x  and  exerting  control  law  u  for  all 
x  €  1R,  u  €  <&. 
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A  natural  subclass  of  for  this  problem  consists  of  the 

markovian  laws  that  give  rise  to  an  ergodic  solution  process  (xt) 
in  (4)  .  Those  laws  are  of  the  form  ut00  =  b(xt),  b  :  1R  -*■  1R 
measurable  and  such  that  Fu(«>)  <  « ,  with 


FU(x) 


A 


[  exp{2 


[y 

b(z)dz}dy. 

0 


(8) 


It  is  proved  in  Gihman  and  Skorohod  [7;  §18]  that  the  process  (x^) , 
corresponding  to  such  a  law  u,  exists  in  the  strong  sense  and 
admits  Fu(x)/Fu(°°)  as  a  (unique)  invariant  probability  distribution 
function,  in  the  sense  that 


f 


p(x£  <  y | Xq  =  x)dFu(x)  =  Fu(y);  0  <  t  <  T,  y  £  K 


(9) 


k  -  V-  f 

1  >  0  T-*»  F  (®)  >  - 


f (y)  dFu(y);  a.s.  (P)  and  L' (E) ,  (10) 

uniformly  on  bounded  x  sets. 

*00 

lim  E  [f  (xV)  |  x«  =  x]  =  — f(y)dFu(y)  (11) 

t-H»  *•  u  Fu(<*>)  *  -® 


for  any  Borel  measurable  function  f(-)  for  which  the  integrals  in 
(10),  (11)  exist,  and  any  x  €  1R. 


Definition  2:  Let  &  be  the  class  of  laws  of  the  form  u^(x)  = 
b(xt)  such  that  both  Fu(»)  <  «>  and 


(Hx)  +  bZ(x)}dFu(x)  <  » 


(12) 
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are  satisfied. 

It  is  seen  from  (10)  that  the  limit  in  the  performance  index 


J(u) 


lim 

T-*-oo  1 


+  J  (xU) } dt 


(7)’ 


exists  and  is  independent  of  the  starting  point  x  €  ]R. 


LEMMA  1 :  For  the  solution  v(Q  of  equation  (3)  with  v(0~l  =  0 , 


sgn  vx(x)  =  sgn  x  (13) 

vx(|x|)'v  |  x  | m ,  as  |  x  |  (14) 

Proof :  Consider  d  >  0  such  that  <P  (d)  =  X  and  note  that 

* 

( z  (x))”  is  negative  on  (0,d),  positive  on  (d,°°).  Since  z*’(0)  = 
lim  (z*(x)) ’  =  0,  this  implies  (z*(x))'  >  0,  hence  v  (x)  >  0,  on 

X-voo  X 

(O,00).  (13)  follows  by  oddness  of  v^(x)  in  x,  while  (14)  is  a 

consequence  of  equation  (3)  and  the  corresponding  growth  condition 
on  <P  (•  )  ,  q.e.d. 

Consider  now  a  probability  space  (ft.j^.P;  ^.)  and  an 
^-adapted  Brownian  Motion  process  (w^;  t  >  0}  defined  on  it. 

The  stochastic  differential  equation 


d$t  =  -vx(5t)dt  +  dwt;  i  -  0 
=  x 


(15) 


has  a  strong  solution  on  (n,  &,P;  J£)  because  of  (B) ;  see 
Proposition  2  below.  The  implicit  minimization  in  (3)  suggests  that 
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(Sj.;  t  >  0}  achieves  the  infimum  of  J(u)  in  (7)',  u  €  in 
fact  we  have  the  following  result: 

PROPOSITION  1:  The  control  law  u*U)  =  "vx(xt)  is  optimal  in  if. 

«j^ 

Proof :  First  it  is  checked  that  u  €  if.  In  fact, 

F*(x)  =  [  exp{ - 2  v  K)dUdy  =  (  (z*(y))2dy,  F*(»)  =  1 

J  -00  0  A  J  -OO 

and  thus  condition  (12)  follows  from 

.  oo 

j  (Hx)(z*(x))2  +  \  (z*'(x))2)dx  =  x*,  (16) 

which,  in  turn,  is  easily  obtained  from  (1)  with  z,X  replaced  by 
z*,X”  upon  multiplying  throughout  by  z*  and  integrating  over  IR. 
Conditions  (5)  and  (6)  are  also  readily  verifiable;  see  (24)  below. 

To  prove  optimality  of  u*  in  if,  consider  any  law  u  €  if 
and  apply  Ito's  rule  to  v(x^);  taking  equation  (3)  along  with 
conditions  (14),  (6)  into  account,  one  gets 

Ev(x“)  -  v (x)  +  E  |  «(x“)  +  \  u2(xu)}ds  >  X*t.  *  (17) 

But  lim  Ev(x^)  =  (Fu(<*>))  *  [  v(y)dFu(y)  <  «>  by  virtue  of  (11), 

t+®  z  I  -oo 

* 

so  one  obtains  J(u)  >  X  upon  dividing  both  sides  of  (17)  by  t 
and  passing  to  the  limit  as  t  -*>  ».  If  u  =  u* ,  (17)  becomes  an 
equality  and  therefore 
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T 

J(u*)  =  lim  i  E  f  {♦(5t)  +  J  v2(Ct))dt  =  X*.  (18) 

T->»  1  J  0  z  c  x 

So  u*  is  optimal  in 

LEMMA  2:  P(|5  |  <  | x+wt |  ,  t  >  0)  =  1. 

Proof:  An  easy  consequence  of  (13),  Proposition  1  and  the  Ikeda- 
Watanable  comparison  Theorem  [10]. 

3.  A  FAMILY  OF  FINITE-HORIZON  CONTROL  PROBLEMS 

Under  the  same  assumptions  and  definitions  as  in  Section  2, 
consider  the  problem  of  finding  the  optimal  law  u*  (x) ;  0  <_  t  <_  x 
in  &  that  minimizes  the  expected  total  cost 

'j’ 

I(x,T;u)  =  e“  |  (♦(x")  +  \  u2(xu))dt,  0  <  X  <  T. 

The  Bellman  equation  for  the  value  function  V(x,x)  on  1R  *  [0,T] 
associated  with  this  problem, 

2 

VT  -  J-  V  -  4  V2  +  <P(x)  «  \  V  +  min(uV  +  ^-)  +  <Kx);  (x,x)  €  1R  *  (0,T]  (19) 
T  2  xx  2x  v  2  xx  ^  x  2 

V(x,0)  *  0  ;  X€  1R,  (20) 

2  1 

has  a  unique  classical  solution  which  is  C  ’  in  ]R  *  (0,T], 
continuous  on  1R  *  [0,T]  and  satisfies  a  polynomial  growth 

condition  in  the  space  variable;  see  Fleming  [4].  It  is  easily 
checked  that  V(x,x)  is  an  (achievable)  lower  bound  on  I(x,x;u) 
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and  that  it  is  even  and  convex  in  x  for  any  x  £  [0,T]  (Tor  the  first  claim, 
apply  Ito's  rule  to  V(x^  ,x-t) ,  u  £  CU\  symmetry  follows  from  uniqueness  and 
the  fact  that  W(x,x)  =  V(-x,x)  is  also  a  solution  to  (19),  (20); 

for  convexity,  see  Fleming  and  Rishel  [6],  Ex.  VI.  9).  The 

minimization  in  (19)  is  achieved  for  u  =  -V  ,  a  fact  suggesting 
that  the  infimum  of  I(x,x;u)  is  achieved  by  the  process 
{ nt ;  0  <_  t  <_  t>  defined  through 

-Vx(nJ,T-t)dt  +  dwt;  0  <  t  <  x 

(21) 

x 

and  that  the  optimal  control  law  in  %  for  the  problems  on  [ 0 , t ] 

is  ut(x)  =  -Vx(xt,x-t) ;  0  <  t  <  t,  x  £  C[0,T). 

PROPOSITION  2:  The  stochastic  differential  equation  (21)  is  strongly 
solvable  on  the  probability  space  (n,^,P;  j^.) . 

Proof:  The  symmetry  and  convexity  properties  of  V(x,x)  suggest 

that 


V  (x,r)  >0,  on  x  >  0.  (22) 

x 

In  what  follows  we  adapt  an  argument  of  Fleming  [5] .  Consider  the 
expanding  sequence  of  intervals  Gn  =  (-n,n)  and  the  corresponding 
sequence  of  functions  3n  £  C°°QR);  0  <  3n  <  1 ,  3nCx)  =  1  in  Gn, 
enOO  =0  in  Gn+1«  The  functions  fnCx,x)  =  -Vx(x,x)  3nCx)  satisfy 
both  a  Lip  and  a  linear  growth  condition  in  x,  hence  the  process 
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{rt^,n;  0  <  t  <  t}, 

dnt’n  =  fn(r)T’n.T't)dt  +  dwt;  0  5  t  <  t 
'I'*  -  x  6  Gn’ 

is  well  defined  in  the  Ito  sense,  for  all  sufficiently  large  n  £  IN. 
Besides,  if  m  <  n,  then  =  \,n,  0  <  t  <  *m,  where 

Tn  =  inf { t  <  i;  | n^,n|  >  n} 

=  t,  if  Inj,n|  <  n,  all  0  <  t  <  X. 

Denote  by  the  a.s.  limit  of  the  increasing  sequence  Tn  and 

define  =  0^’n,  for  n  large  enough  and  0  <  t  <  to.  We  prove 

that  n*  is  defined  on  the  whole  of  [0,x],  i.e.  that  x  =  t ,  a.s. 
t 

It  is  easily  seen  from  (22)  that  the  process  qt’n  =  (0t,n) 

+  t  -  t,  0  <  t  <  t  is  a  nonnegative  supermartingale.  Therefore, 

2 

P(x  <  t)  <  P(  sup  q*,n  >  n2)  <  +  0  as  n  -*■  °°, 

n  '  0<s<t  r  n 

any  0  <  t  <  x .  Consequently,  x^  =  x ,  a.s.(P);  Q.E.D. 

4.  ASYMPTOTIC  BEHAVIOUR  OF  THE  VALUE  FUNCTION 

In  this  section  we  establish  the  main  result  of  the  paper, 
Theorem  1,  which  gives  an  asymptotic  relationship  between  the 
optimal  expected  performance  V(x,x)  on  [0,x]  and  the  optimal 
steady-state  performance  rate  A  .  This  relationship  is  used  to 
establish  the  stochastic  representation  (2)  for  A*  (Theorem  2)  and 


11 


to  prove  the  optimality  in  of  the  law  u*  for  the  stationary 

problem  (Theorem  3) . 

LEMMA  3:  V(x,t)  <  v(x)  +  X*t;  (X,T)  €  JR  *  [0 ,  T)  ,  any  T  >  0. 

Proof :  The  stationary  optimal  law  u*(x)  =  -vx(xt)  is  suboptimal 
for  the  finite-horizon  problem;  we  have  therefore  from  equation  (19): 

Vx  -  1  Vxx  +  I  vx  '  vxVx  +  *(x):  Cx’T)  6  K  X  C0»T]- 
Consequently,  the  function 

W(x,t)  =  v(x)  +  A*t  -  V(x,t) 

satisfies  the  differential  inequality 

Wx  >  \  Wxx  -  vxWx;  (x.x)  €  1R  x  (0 ,T] 

along  with  the  initial  condition  W(x,0)  =  v(x);  x  £  K. 

An  application  of  Ito's  rule  to  W(5t,T-t)  gives  the  stochastic 
differential  inequality  dW(5t,T-t)  <  Wx(^t ,T-t)dwt,  which  implies 
that  (W(5t,T-t);  0  <  t  <  is  a  supermartinglae  since,  due  to 
the  polynomial  growth  condition  of  Wx  in  x  and  Lemma  2,  the 
process 


I 

! 
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is  a  square- integrable  martingale. 

Introduce  the  sequence  of  stopping  times 

Tn  *  inf{0  <  t  <  t ;  |5t|  5  n} 

(2  3) 

-  x,  if  |Stl  <  n,  all  0  <  t  <  t. 

An  application  of  Ito’s  rule  to  ,  £  >  1  an  integer,  gives 

=  U^(£'1)  [(2£-l)  -  25tvx(5t)]dt  +  2£5j£‘1dwt. 


It  is  easy  to  check  that  for  each  £  >  1  there  exists  a^  >  0  such 
that  £x^£  ^[(2£-l)  -  2xvx(x)]  <  a^ ,  x  €  ]R.  So  the  process 

7  0 

+  a£(T-t);  0  <  t  <  t  is  a  nonnegative  supermartingale  and 
consequently,  for  any  £  >  1: 


cr2£  ^  2£ 

sup  E5  <  x  +  apT 
0<t<r  z  x 


P(T  <  t) 
n 


P(  sup  |C  | 
0<t<T 


>  n)  < 


2 

x  +a. 


Therefore,  T  ■>  r ,  a.s.  as  n  -►  «> ,  and 
n 


(24) 


(25) 


W(x,x)  >  EW(5t  ,T-Tn)  EW(^t,0)  =  Ev(^t)  >  0, 

because  the  family  of  random  variables  W(£t,r-t);  0  <  t  <  x)  is 

2  2k 

uniformly  integrable:  sup  EW  (S.,T-t)  <  Const(t+  sup  E£  )  <  « 

0<t<T  X  '  0<t<T  Z 

by  (24),  some  k  >  1.  Q.E.D. 
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PROPOSITION  3:  vxC|x|,t)  <  vxC|x|);  (x,x)6]Rx  [0,T],any  T>0. 

Proof:  It  is  readily  verified  from  equations  (3),  (19)  by 

differentiation  that  the  function: 

M(x,t)  k  vx(x)  -  Vx(x,r) 

satisfies  the  equation: 

Mt  •  7  Mxx  '  vxMx  -  VxxM;  (X'TJ  £  *  x  (°-TI 
along  with  the  initial  condition: 

M (x ,  0 )  =  v  (x)  ;  x  £  1R. 


Note  also  that: 


M(0,x)  =0;  0  <  i  <  T. 


It  follows  by  Ito's  rule  that 


M(5t,T-t)-exp«j 


|  |0VXX(5S'T-S)d|  *  exp|f„Vxx(5s’T-SJds} 


>Mx(Ct’T't)dwf 


(26) 


Take  x  >  0;  the  result  follows  by  symmetry  for  x  <  0  while  it  is 
obvious  for  x  =  0.  By  the  same  argument  as  in  Lemma  3,  the 
integral  of  the  right  hand  side  of  (26)  over  [0,t]  is  a  square- 
integrable  martingale  on  0  <  t  <  x,  so  that 
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C5t,T-t)dt> 


where 

R  =  inf {0  <  t  <  T;  =  0} 

=  t,  if  >  0  for  all  0  <  t  <  x. 

The  result  follows  from  (27). 

COROLLARY  1:  P(|Ct|  <  |n*|  <  |x+wt| ;  0  <  t  <  x)  =  1 . 

Follows  from  the  Ikeda-Watanable  comparison  Theorem  [10],  along  with 
equations  (15)  and  (21). 


COROLLARY  2:  lim  V  (x,x)  =  v  (x) ,  uniformly  on  bounded  x-sets. 

X-KO  X  X 


Proof ;  From  (27)  we  get  for  x  >  0: 


0  <  v 


00  -  V  (x,x)  <  Ev  (5r)  =  f  v  (ST)d P. 
X  x  R  MR=T)  x  T 


Due  to  Corollary  1: 

P(R  ■  x)  <  P(x+wt  >  0,  all  0  <  t  <  x)  *  2*(x x*1^2)  -  1  -►  0  as  t  ■*■  <*>, 


(27) 


uniformly  on  bounded  x-sets  (*(•)  is  the  cumulative  normal  distribution 
function).  On  the  other  hand,  we  get  from  (11),  (16)  that 
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mOD 

lim  Ev^(it)  =  I  v2(y)  (z* (y))2dy  <  2X*, 

X-fOO  J  —CO 

2 

therefore  sup  Ev  (£_)  <  c  <  which  proves  uniform  integrability 
r>0  x  T  - 

of  the  family  {vx(5T);  t  >  0},  hence  uniform  absolute  continuity, 
hence  the  result. 


REMARK:  Note  that 


dKtl  =  "vx(Kt  I  )dt  +  dwt  +  d*t, 

K0I  =  M 


(28) 


where  is  an  increasing  process  that  off  (t,5t  =  0}  (the 

local  time  spent  by  the  S.  process  at  zero),  and 
rt 

w.  =  sgn  5  dw  is  a  new  Brownian  Motion  on  (fl,^,P;  . 

t  J  Q  s  s 

For  a  discussion  of  equation  of  the  form  (28)  see  Gihman  and 
Skorohod  [7,  §23]  as  well  as  McKean  [13 ; §  S  3 . 8 ,  3.9].  Application 
of  the  generalized  Ito  formula  (Meyer  [14,  p.  565])  to 
M(Ktl  ,T-t)  yields 

dM(|5t|,x-t)  =  V^d^l.T-OMd^l.T-Odt  +  HK(|€t|,t-t)dlt  +  Mx(|5t|,T-t)diit 
*  V„(|etM-t)M(|5t|.T-t)dt  ♦  Mx(Kt|,T-t)di5t, 


because  M  (|5^|  ,*-t)  =  0  on  { t ; 5 ^  *  0),  i.e.  where  dfct  f  0. 

A  new  application  of  Ito's  rule  gives  (26)  with  replaced  by 

|£tl ,  so  finally  if 


16 


Rt  =  inf { t  <  s  <  T;  •=  0} 

=  t ,  if  4S  +  0  for  all  t  <  s  <  i , 


we  get 


A 

vx(KtD  '  VlCtl.T-l)  =  E 

vx(Kr  |)-exp< 

> 

& 

-- 

> 

(27)' 


THEOREM  1:  lim  ^ ^  =  X*,  uniformly  on  bounded  x-sets. 

T-voo 


Proof:  By  Corollary  1  and  convexity  of  <f>,V  in  x: 

,x  T 

v(x,T)  =  E  J0{4,Cnt)  +  IvJ(VT't)}  -  E  J  +  I  Vx^t’X't)}dt* 

Therefore , 

T  E  l0W(5t)  *  I  vx®t) dt  -  h  |/tvx«t>  -  v^st’T-t»dt 

(29) 

<  Hidl  5  x*  +  v&!  . 


The  first  term  on  the  left  hand  side  of  (29)  converges  to  X*  as 
t  -*•  «,  uniformly  on  bounded  x-sets.  For  the  integrand  of  the  second 
term  we  have  the  estimate 


vx(|5t,)vx(|5xl)dP»  (30) 


where  Proposition  3,  relation  (27)'  and  the  convexity  of  V(’,t) 
have  been  taken  into  account.  Splitting  the  integral  in  (30)  over 
the  events  {T^  =  t}  and  {T^  <  t},  Tn  as  in  (23),  we  get  the 
estimate 


Tc  E  l0{vxKt}  '  Vx(H’T't)}dt  -  const. T*1/2n2n 

*f,T 


For  the  choice  t  =  n^m+^  the  first  term  on  the  right  hand  side 
of  (31)  tends  to  zero  as  n  ®,  while  (25'  with  fc  *  2(m+l)  gives 
P(Tn  <  n^m+3)  ■+■  0  as  n  uniformly  on  bounded  x-sets.  On  the 

other  hand,  the  family  of  random  variables 


vx(Ktl)dt-vxCKT|); 


i  > 


is  uniformly  integrable; 
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indeed,  we  have  by  the  Cauchy  inequality: 


1 


vxcKtl)}Tvx(Ktl)dIl 


CKt  |  )dt*Ev^(|CT|  ) 


<  c 


<  00 


2 

where  c  is  an  upper  bound  on  sup  Ev  (5 T)  (Corollary  2). 

T>0  X 

By  uniform  absolute  continuity  the  second  term  on  the  right 
hand  side  of  (31)  also  converges  to  zero  as  x  =  n^m+'5  -*•  °°,  uni¬ 
formly  on  bounded  x-sets.  Therefore,  both  left  and  right  hand 
sides  of  the  double  inequality  (29)  converge  to  A  as  x  -►  oo  > 
uniformly  on  bounded  x-sets;  Q.E.D. 


EXAMPLE:  In  the  case  <p  (x)  =  x2,  we  have  A*  =  1//2, 

2 

z(x)  =  const.  exp(-  — ), 

/2 

v (x)  =  x2//2,  V(x,x)  =  (a(x)x2  +  Ca(s)ds)/SZ , 

with  a(x)  =  tan  (x/2).  The  results  of  the  present  section 

are  readily  verified. 


THEOREM  2 :  The  principal  eigenvalue  A  of  the  eigenvalue  problem 
(1)  admits  the  limiting-stochastic  representation  (2) ,  uniformly 
on  bounded  x-sets . 

Proof :  The  change  of  variables  m  *  exp(-V)  transforms 
equation  (19)  into  the  linear  equation  with  potential  term: 


m 
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mT  =  \  mxx  -  <Kx)m;  (x,x)  €  JR  *  (0,T] 
m(x,0)  =  1  ;  x  C  ]R. 

It  is  checked  that 


r 

f 

rt 

•v 

sm(x+wt , x-t) -exp 

<j>  (x+w  )ds 

0  s  J 

;  0  <  t  <  tl 

j 

is  a  square- integrable  martingale,  hence  the  so  called  Feynman-Kac 
formula: 


r 

fX  j 

m(x,x)  =  E 

exps- 

♦  Cx+W  )ds> 

L  i 

0  5  J 

(2)  follows  from  the  latter  and  Theorem  1. 


THEOREM  3:  The  control  law  u*(x)  =  'vx(xt);  x  e  C[0,«>),  is  optimal 
in  for  the  stationary  control  problem. 

Proof :  Apply  Ito's  rule  to  V(x^,x-t),  any  u  €  ^  and  take 
expectations  to  obtain  by  virtue  of  conditions  (5),  (6)  the 
inequality 


Dividing  by  x 

**  .  lim  1 
A  5  t 


V Cx , 1 )  5  Ex  Cx^)  +  \  ujcxu)}dt. 
and  letting  x  -*■  »  we  g6t 
E  |^{<Kx^)  +  j  u^(xu)}dt  *  J(u.x),  any 


x  €  1R. 
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Since 


X*  =  J(u*) 


the  optimality  of 


* 


u 


follows . 
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